Prototyping Multimodal Interfaces with the SMUIML Modeling Language
نویسندگان
چکیده
In this position paper, we present an approach geared toward rapid prototyping of multimodal interfaces with SMUIML (Synchronized Multimodal User Interfaces Markup Language) and HephaisTK toolkit. The goal of SMUIML and HephaisTK is to offer developers with: on one side, a language allowing clear description of human-machine multimodal dialog and control over the way multiple input modalities have to be fused; and on the other side, an extensible tool implementing and managing this dialog.
منابع مشابه
A graphical editor for the SMUIML multimodal user interaction description language
We present the results of an investigation on software support for the SMUIML multimodal user interaction description language (UIDL). In particular, we introduce a graphical UIDL editor for the creation of SMUIML scripts. The data management as well as the dialogue modelling in our graphical editor is based on the SMUIML language. Due to the event-centered nature of SMUIML, the multimodal dial...
متن کاملA Graphical UIDL Editor for Multimodal Interaction Design Based on SMUIML
We present the results of an investigation on software support for the SMUIML multimodal user interaction description language. In particular, we introduce a graphical UIDL editor for the creation of SMUIML scripts. The presented graphical editor is fully based on SMUIML for the representation of the underlying data as well as for the dialogue modelling. Due to the event-centered nature of SMUI...
متن کاملMatch: Multimodal Access to City Help
Interfaces to mobile information access devices need to allow users to interact using whichever mode or combination of modes are most appropriate, given their user preference, task at hand, and physical and social environment. This paper describes a multimodal application architecture which facilitates rapid prototyping of flexible nextgeneration multimodal interfaces. Our sample application MA...
متن کاملMIBO - A Framework for the Integration of Multimodal Intuitive Controls in Smart Buildings
With the Internet of Things expanding into our homes and offices, we can expect fixtures in buildings to become more interconnected and more numerous as part of an increasingly complex and powerful integrated smart environment. However, this raises new challenges in the area of usability since today’s rooms are already cluttered with multiple user interfaces in the form of buttons and remote co...
متن کاملmTalk - A Multimodal Browser for Mobile Services
The MTALKmultimodal browser is a tool which enables rapid prototyping for research and development of mobile multimodal interfaces combining natural modalities such as speech, touch, and gesture. MTALKintegrates a broad range of open standards for authoring graphical and spoken user interfaces and is supported by a cloud-based multimodal processing architecture. In this paper, we describe MTALK...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2007